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ABSTRACT 



In computer vision many techniques have been developed for object recognition. 
The affine invariant matching algorithm proposed by Hummel and Wolfson (198S) is a 
new and interesting method. Under affine invariant transformation, objects with trans- 
lation, rotation, scale changes, and/or even partial occlusion will have the same or simi- 
lar coefficients. However, some serious problems exist in the original algorithm. 

This thesis begins with the discussion of the affine transformation. The shortcom- 
ings that can occur in this method such as the basis instability, the collision of hash ta- 
ble, and the noise sensitivity will be discussed. Among them the noise sensitivity is a 
serious problem. This can always cause the recognition procedure to fail. In this thesis 
an improved affine invariant matching algorithm was developed to overcome the noise 
problem and other disadvantages of the original algorithm. 

The area test criteria were adopted to avoid the numerical instability problem. The 
modified hashing structure using a special hash function was implemented to achieve 
faster accessing and voting. In the recognition procedure, the partial voting technique 
with the consideration of false peaks from the voting array highly enhanced the noise 
tolerance of the algorithm. Finally, the results obtained from the improved algorithm 
clearly showed better performance than those of the original algorithm. 
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I. INTRODUCTION 



Recognition of objects in natural scenes is a major subject of study in computer vi- 
sion. It is important in many applications including robotics, automated inspection, and 
aerial photo-interpretation. A number of practical recognition systems are model-based 
systems where the task is to match known models against the test objects in the scene. 

Generally, according to the matching scheme the techniques for 2-D object recog- 
nition can be classified into three categories. They are template matching, feature 
matching, and transform matching. Template matching is the oldest technique known. 
It is basically a technique of 2-D cross-correlation between the model object and the test 
object. In feature matching a structural model of the object in terms of features or ob- 
ject primitives is constructed. Recognition is based on the structure. These features can 
be served as a compact description of the object and can be easily extracted from it. 
The above two matching techniques are performed in the original 2-D spatial domain. 
The last approach is to transform the original data into a different domain with the 
matching done in this new domain. (Ref. 1: pp. 14-20] 

The representation method of an object determines the complexity of the matching 
algorithm and also places a limit on the capability of the matching algorithm. For ex- 
ample, a representation based on the Fourier Descriptors can not handle the partially 
occluded objects because of its global Fourier feature. Therefore, an ideal object repre- 
sentation shall have the following desirable characteristics [Ref 2] : 

• It should be local. This means that the coding of an object is not dependent on the 
entire boundary', nor is it dependent on an external reference point such as a 
centroid or a starting point. 
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• It should be independent of the orientation, scale, and even partial occlusion of the 
object. 

• It should be bounded. This means that a small change to part of the boundary 
should produce only a small local change in the representation. 

• It should allow for efficient and robust matching in the presence of noise. 

• It should uniquely specify a single object. 

• It should contain information about the object at var>'ing levels of details so that 
the matching process can be performed at different levels of coarseness. 

• It should be computationally efficient. 

These characteristics of object representation are ideal, and it is by no means obvious 
from the outset that a representation with such characteristics can be found. 

.Many techniques were developed for object representation and matching in the above 
three catecories, but none of them are simultaneouslv orientation, scale, and occlusion 
invariant. The affine invariant matching proposed by Hummel and Wolfson (1988) is a 
new and efl'icient transform matching technique which can handle objects with changes 
in scale, orientation, and partial occlusion. However, this technique has some short- 
comings. 

The purpose of this thesis is to discuss these shortcomings and derive the solutions 
to overcome the corresponding problems. There are five chapters included in this thesis. 
Chapter 1 is a brief description of 2-D object recognition and the ideal representation 
characteristics. Chapter II presents the principle of affine invariant transformation and 
its original implementation on point matching. In Chapter HI the emphasis is on the 



2 



discussion of the shortcomings of the original matching algorithm such as the basis in- 
stability, the collision of hash table, and the noise problem. Then, solutions were derived 
to overcome these problems. Among these shortcomings, the main weakness of the or- 
iginal matching algorithm is its sensitivity to noise perturbation. This will always cause 
the recognition procedure to fail. One side effect caused by the solution to reduce noise 
perturbation is that the matching algorithm suffers from false peaks in the accumulator 
array due to the partial voting technique. All the problems and solutions will be dis- 
cussed in detail in this chapter. In Chapter IV, these solutions were implemented in the 
improved affine matching algorithm in order to enhance some of the ideal characteristics 
of the object representation and matching algorithm. Hence, the new algorithm can 
work better in a real situation. In other words, it can handle noisy test objects and still 
preserve scale, orientation, and occlusion invariance. Chapter V shows the results ob- 
tained from the computer experiments. By comparing the results reported here with the 
results of the original algorithm, the new algorithm clearly shows better performance 
tnan the original method. Finally, Chapter VI presents the conclusions and the rec- 
ommendations for future study. 
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II. DISCUSSION ON AFFINE INVARIANT MATCHING 



A. AFFINE TRANSFORMATION OF PLANAR POINTS 

1. General Statement 

From a theoretical as well as a practical point of view, feature transformation 
is an important topic in object recognition. The affine transformation is a new method 
to characterize objects with invariance in respect to translation, rotation, scale change, 
and partial occlusion. But the most important characteristic of all is the simplicity of 
this method. 

The study is concentrated on the recognition of 2-D flat rigid objects. Under 
this restriction, two different images of the same flat object are in affine correspondence, 
i.e., there is a non singular 2x2 matrix A and a 2-D (translation) vector b, such that 
each point x in the first image can be translated to the corresponding point Ax + b in 
the second image. Our problem is to find the correspondence of the objects in a scene 
and a stored model in the data base. [Ref 3; pp. 3-4] 

In order to identify the occluded or overlapped objects, a local feature must be 
used. Local features depend only on the shape or structure of the object restricted to a 
small area. In the study here the local point feature is used. 

2. Transform Representation 

It is well known that any three non-collinear points (called a triplet or a basis 
triplet) can uniquely specify a plane. Consequently, affine transformation of a plane is 
associated with the transformation of three non-collinear points. Moreover, the affine 
transformation is unique because it maps any non-collinear triplet in one plane to an- 
other non-collinear triplet in the other plane. 
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Suppose a set of points {called interesting points) of an object is extracted from 
an image. Any three non-collinear points of the set form a triplet. The affine coefficients 
(c, ;/) of the rest of the points of the object can be calculated based on this particular 
triplet. The most important characteristic of this transform is that for each non-collinear 



other words, the same point of the object transformed on different basis will have the 
same affine coefficients. 

Let a, b, c denote the vectors of a selected triplet of the plane, and T denotes the 
transformation to a different plane. As shown in Figure 1, one can express the affine 
coefficients (T , ?/) of an arbitrary point p by the following equation : 



Hence, given the affine coefficients and the triplet, the corresponding point in 
an image can be computed by 



If both the point p and its triplet are transformed by T to a new image plane, 
its new affine coefficients are 



triplet the affine coefficients of all other points of the object are affine invariant. In 




( 2 . 1 ) 




p = c(a — c) + i/(b — c) + c. 



( 2 . 2 ) 




= (T(a-c b - c))~T(p - c) 
= (a-c b - c)"’t~'t(p - c) 
= (a — c b — c)~’(p — c). 



(2.3) 
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From equations (2.1) and (2.3), it is clearly proven that the alline coeindcnts 
are transform invariant [Ref 4: pp. 3-4]. Figure 1 shows the invariant property grapli- 
ically. 

B. ORIGINAL MATCHING ALGORITHM 

As was mentioned in the previous section, given a triplet, each point of the plane 
can be represented as a coelFicient pair (<J, i/) on this basis. Since there is no preference 
for any specific triplet, the set of model interesting points from the model can yield a 
large number of non-collinear triplets. Given m interesting points of the model at least 
CiP\ — N cases should be considered, where N is the number of undesired collincar 
triplets. For object recognition considered here, interesting points of a test object is 
going to be used to match those of the stored models. If there are n points in the test 
object, the worst case complexity for recognition using this method is {nt x //)’ x i , where 
t is the complexity of verifying one point of the model against that of the test object. 
Again if n and t are in the same order of magnitude as m, the worst case complexity 
could be of order m\ [Ref. 3: pp. 6] Such a complexity is quite unfavorable. Hence, it 
is necessary to divide the algorithm into two difierent steps. The first one is an off-line 
step called preprocessing, and the second one is an on-line step called recogniiion. The 
objective here is to identify the test object in a scene as one of the possible models 
stored. The two steps are explained briefly as follows. 

1. Preprocessing (Off-line Step) 

a) Represent the model objects by a set of interesting points. 

b) For each non-collinear triplet, calculate the coefficients ?/) of all the other model 

interesting points on this basis triplet. 

c) Use these coefficients by hashing them into an entry of a table (called hash tabic). 

The entry stores all the corresponding pairs (modclno, tripletno) for those affine co- 
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Figure 1. Affine invariant characteristic 
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efllcients (if, )/). Within the hashing structure all entries with the same coefTicients are 
linked together by pointers. 

d) This is done for as many models as necessary, i.e., for each different model repeat 
procedures a) to c). 

2. Recognition (On-line Step) 

a) Input a set of interesting points of the test object in an image. 

b) Choose a non-collinear triplet as a basis, compute the coefficients {^, rj) of the other 
points based on this triplet. 

c) For each coefficient pair (c,t/), the hash table is accessed and a vote for the ap- 
propriate entries is tallied. 

d) If a certain entr>' in the hash table obtains the largest number of votes, the data 
related to this entrv' can be reconstructed and shown on the display. 

e) Check another model as necessary, i.e., repeat procedures a) to d). 

This two-step algorithm is illustrated in Figure 2. 

C. SHORTCOMINGS OF AFFINE INVARIANT MATCHING 

Besides the disadvantage of complexity, there are other shortcomings that limit the 
accuracy and efficiency of the scheme. These shortcomings are discussed in the follow- 
ing. The solutions to these problems will be the subject of the next section. 

1. Basis Instability 

In order to understand the basis instability problem it is advantageous to inter- 
pret the affine transform from the geometrical point of view. It is possible to rewrite 
equation (2.1) in terms of the components of the coordinates of vectors a, b, c, and p as 
follows 
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Figure 2. Flow chart of the affine invariant matching algorithm 



(2.4) 



/iPx (^Jc ^x)(Py 

\(a^ - Cj,)jpy - C^,) -{Px- Cx)(^y - Cy)/ 

{Qx C^(by Cy) {b^ Cjf)(fly Cy) 



More explicity the affine coefficients are given by 

, jPx - Cx){by - Cy) - {b^ - C^)(Py - Cy) 

(Ox ^x)(^y fy) (^x ^x)i^y fy) 



(2.5) 



and 



(^■X - Cx)(/’y - (^y) - (Px - ‘^xX^y ~ ^y) 

~ i<^x - C;c)(^' - 9) - - <^x)(«y - Cy) ' 



(2.6) 



If equations (2.5) and (2.6) are interpreted from the geometrical point of view, 
, .ie affine coefficients b and >/ are both ratios of areas. The area of the basis triplet tri- 
angle is given by 



^abc 



J_ 

2 



CXX Cly 1 

bx by 1 



Cx Cy 1 



(2.7) 



The determinant can be simplified to 



1 


1 

1 

sT 




2 


1 

1 





( 2 . 8 ) 



or 
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(2.9) 



^abc 



C^){by Cy) 



which is identical to the magnitude of the denominator of equations (2.5) and (2.6), ex- 
cept for the 1/2 factor. 

In other words, the denominator of equation (2.5) or equation (2.6) is propor- 
tional to the area of the triangle for which the vertices are the three non-collinear basis 
points a, b and c. Similary, the numerator of ^ is proportional to area which is the 
area of the triangle that consists of points b, c, and p. The numerator of t] is propor- 
tional to which is the area of the triangle that consists of points a, c, and p. 
Figure 3 shows the geometrical interpretation of the affine transformation. 

If the area of A^t^ is too small compared to the area of Ai,^,, or A,,,,, the magnitude 
of the afline coefficient will be a very large number. This effect will cause the numerical 
instability in the affine plane. [Ref 4: pp. 6-7] 

2. Collision of Hash Table 

Even if the unstable triplet points are ruled out, the values of i and ;/ tend to 
concentrate highly around zero, i.e., these values are closing toward the origin of the 
affine plane, as shown in Figure 4. These small values of I and ?/ will generate many 
long linked lists in the hash table, which causes serious collisions of entries in the table. 
Under this circumstance, the hash table accessing time increases, and the situation be- 
comes impractical due to the numerous collisions. Thus, a special function which can 
distribute these small values to a large region is needed. 

3. Noise Perturbation 

When the test object appears in a real scene, usually the extraction of local 
feature (interesting point) is inaccurate to a certain extent in the presence of random 
fluctuations or "noise". In this scheme the local feature used is a set of fixed-value co- 
ordinates of the interesting points. If these points are perturbated in the presence of 



11 




Figure 3. Geometrical interpretation of affine transformation 

noise, the corresponding affine coefficients t and ?/ will deviate from the accurate values 
in the affine plane. 

In order to show how the affine coefficients are affected by the noise, it is ben- 
eficial to take a look at a simple example as shown in the following. If the coordinates 
of a test triplet < a, b, c> and an arbitrary' point p are given by 
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Figure 4. 
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Histograms of the affine coefficients: (a) original; (b) ruling out un- 
stable triplets; and (c) same as (b) wth x axis scaled to smaller range of 
values. [From Ref. 3: pp. 8] 
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Using equations (2.5) and (2.6), we have 

^= 1 , >/ = - 2 . 

Assume that the point vectors b and p are perturbated by the presence of noise and that 
their coordinates change to 





31' 




"40.5' 


b = 


.39.5. 


- P = 


11. 



Again, by using equations (2.5) and (2.6) 

r = 0.875. ?/' = -2, 



so that the deviations 



^c = t-t' = 0.875, At; = ?/-;/' = 0. 

Since the affine coefficients of the model interesting points are integer values, 
the above small deviation will cause an erroneous or a failed match in the hash table. 

Figure 5 shows the voting results of the accumulation array in the hash table. 
From this plot it can be seen that the votes of most triplets decrease due to the noise 
perturbation. This means that potential erroneous matching can occur in the hash table. 

Obviously, the affine transformation of a point is very sensitive to noise per- 
turbation. This will always cause the recognition procedure to fail. For real images the 
background noise is inevitable. Hence, the noise sensitivity of affine transform matching 
is the main problem to be solved in this study. 
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Figure 5. Voting results of the accumulation array in tlie hash table 
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D. SOLUTIONS TO THE PROBLEMS 



This section discusses the solutions to the shortconiings of the affine matching al- 
gorithm. 

1. Screening to Reduce Numerical Instability 

The selection of triplets is an important step in either the preprocessing or the 
recognition procedures. If a triplet yielding a relatively small area is used as a basis, it 
will cause large amplification of noise in the affine plane, i.e., the error of t and rj will 
become very large. Therefore, the solution to the instability problem is t.p .rule out this 
kind of undesirable triplets. 

The concept of "relatively small area" is an ambiguous idea. It can var>’ from 
object to object. It is necessan.' to explain this in detail. In order to get a reflexible 
criterion, the triplet's area is compared with the total area of the object. The following 
restrictions are required for both the preprocessing and the recognition (Ref 4: pp. 8). 

• In the preprocessing step, only the non-collinear triplet with an area of at least 1/20 
of the total area of the object will be used. 

• In the recognition step, the non-collinear triplet used should have at least 1, 10 of 
the total area of the object. Here, adoption of the factor 1/10 instead of 1/20 is due 
to the consideration of noise perturbation in the recognition step. Because the in- 
put image is always affected by the background noise, a less stringent tolerance is 
adopted. 

By ruling out these undesirable triplets, not only can the numerical instability 
problem of this scheme be solved, but also the bounds of coordinates in the affine plane 
can be determined. This results in a smaller and efficient hash table. 
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2. Hashing Function 

From the observation of the affine coefficients it can be seen that the higher 
concentration occurs at small values, i.e., values of ^ and 1 / close to the origin of the 2-D 
affine plane. The phenomenon of the concentration of small values of affine coefficients 
induces many long linked lists in the hashing table. Consequetly, the accessing time of 
the hash table in this algorithm deteriorates. Thus, it is intuitively beneficial to use a 
special hash function to scatter those small values as far apart as possible in the affine 
plane. 

Besides the linear hash functions with bad performance, there are some non- 
linear hash functions with a good performance available, such as atan, asinh and tanh. 
Figure 6 shows these functions. From the experimental results, atan seems to be the 
best one as it can scatter the small affine coefficients over a wide range of the affine 
plane (Ref 4: pp. 9-10]. Hence, the size of the linked list can be reduced through ap- 
propriate quantization in the affine plane. The hashing concept and the quantization 
problem will be discussed in the next section. 

3. Noise Problem 

The afline invariant matching algorithm is very rigid in calculating the coeffi- 
cients t and ?/. If the coefficient pairs are based on noisy interesting points, the recog- 
nition will fail due to the error matching in the hash table. Consequently, the noise 
sensitivity of this matching system is a serious problem. In order to solve the disad- 
vantage of noise sensitivity, some techniques to improve this main problem are pro- 
posed. 

a. Quantization in the Affine Plane 

In the original algorithm the hash table can be considered as a two 
dimentional array of pointers, each pointer points to the entry with the same affine co- 
efficients. Hence, the implementation of the hash table is essentially quantization of the 
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Figure 6. Hashing functions of atan, asinh, and tanh 
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affine plane with infinite number of bins (or buckets). Each bucket in the hash table is 
indexed by the quantized coefficients (c, i/). But, the original approach has a lot of 
shortcomings as mentioned before. In order to tolerate the noise perturbation on the 
test image, a quantization with finite number of bins is necessarx'. 

Generally speaking, the bigger the table size, the better the spatial resol- 
ution of the quantization. However, under the consideration of noise perturbation there 
is actually a trade-off between the total number of bins and the bucket size. Although 
using a smaller total number of bins can tolerate more noise perturbation, longer linked 
lists will increase the accessing time of the hash table. If the quantization bin size is 
reduced, it will be difficult to survive in the presence of noise. After trying many bucket 
sizes and total number of bins in different cases, the same conclusion as Costa, flaralick, 
and Shapirp [Ref. 4: pp. 10-11] was reached, i.e., there is no optimal hash table size that 
can work well for all data. The table size used here for all experiments was 90 x 90. 

Before spatial sampling the affine plane, the bounds for both the coefficients 
<f and 1 / should be knovvn. According to the assumptions made in the first section of this 
chapter, the maximun and minimum values of the affine coefficients can be calculated. 
Referring to Figure 7, the bounds of c and ?/ can be derived as follows. 

The image plane has a spatial resolution of 512 x 512. Points a, b. c make 
up a set of non-collinear triplet, and p is an arbitrarx' point on the same plane. In order 
to find the ma.ximun and minimun bounds on ^ and >/, the worst cases shown in 
Figure 7 are considered. Assume A is the area of the input object. The triplet is at the 
lower left hand corner, and the arbitrary point is at the upper right hand corner of the 
image plane as shown in case (a). In case (b) the position of the triplet and the arbitrary' 
point are reversed. Let the magnitude of both the vector ca and the vector cb equal to 
A , xvhich equals previous restriction. Using equation (2.5) and 

equation (2.6) for case (a) yields 
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a = (0, A) 
b=(A,0) 
c = ( 0, 0 ) 
p = (512,512) 
(512 



40 






Figure 7, Calciilntiori of the hounds of affine coefficient 
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Similarly results for case (b) can be obtained. Hence, the bounds 
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Having the bounds on ;; and the 90 x 90 table size, it is possible to compute the bin 
width Ac and A>/ as follows 
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b. Improved Hash Structure 



Hashing is an efficient technique for address calculation. Sometimes, it is 
also called a randomizing or scrambling method. In this technique the item's feature is 
converted into a near-random number, and this number is used to determine where the 
item is going to be stored. Within the hash table ever>- item is associated with an affine 
coefficient pair. By using the atan hashing function and the 90 x 90 spatial quantization 
the original entry inde.x {q, ?;) is replaced by the pair (i, j). 

In the remainder we discuss how to use the index (i, j) to generate the entry 
key and how to convert the key into a more or less random number uniformly distrib- 
uted in the hash table. In the following discussion the entr>’ key is called an inkey, and 
the random number is called a hashkey. 

( I ) Generation of inkey. The hash table is a two dimentional structure 
indexed by (i, j). and an inkey is a one dimentional variable. Conversion of (i, j) to an 
inkey will cause collision of entries. In order to reduce this kind of collision, two dilTer- 
ent one-to-one functions with appropriate operations are used. For simplicity, the inkey 
can be computed in the following equation with tan 30° and tan 20° as the two factors, 

inkey' = / x tan 30° x tan 20°. (2-16) 

The two terms in the above equation are two difTerent one-to-one functions so that i, j 
in the equation can not commute with each other and keep the same value of inkey'. 
Due to this characteristic the number of collisions in the hash table can be reduced. On 
the other hand, the value from the above equation is a real number, and to avoid the 
trunction error this number is multiplied by 100 before the trunction. Hence, the 
equation for inkey becomes 



inkey = irunc{inkey' x 100). 



(2.17) 



(2) Generation of hashkey. Given the inkey, it can be converted to a 
hashkey. There are many key-to-address conversion algorithms, such as mid-square 
method, dividing, shifting, folding, and digit analysis ... etc. From the experimental 
conclusion of many researchers, the best choice is the simple division method. [Ref 5] 
Using this method the inkey is divided by a prime number which is approxmately equal 
to or less than the number of the total hash table entries, and the remainder is taken as 
the relative bucket number, i.e., the hashkey. The generation of inkey and hashkey is 
illustrated in Figure 8. 

c. Partial looting 

The noise sensitivity problem can be lessened by using a hash table where 
the bucket size is not ver\' fine. The table size chosen was 90 x 90. In addition, it is still 
possible to improve the matching algorithm by using the partial voting technique. In 
this technique eight-neighbor mesh as shown in Figure 9 is used where each bin has the 
corresponding voting weight. For each interesting point whose quantized affine index 
is (i. j), one vote is counted for the entries (modelno, tripletno) associated with the 
bucket (i, j) and all the eight neighbors of that particular bucket will also receive partial 
votes. For example, entries associated with bucket (i-1, j-1), (i-1, j+ 1), (i + 1, j-1) and 
(i+ 1, j+ 1) will each receive a 0.25 vote; entries for bucket (i-1, j), (i, j-1), (i, j + 1) and 
(i+ 1, j) will each receive a 0.5 vote [Ref 4: pp. 11]. As a result of partial voting there 
will be some false peaks appearing in the two dimentional accumulation voting array. 
The entr>' which received the maximun votes may not be the one of interest. In order 
to get rid of these false peaks an additional verification procedure must be considered. 
The verification procedure will be discussed in the implementation of the algorithm. 
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Figure <S. Generation of inkey and haslikey 
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Figure 9. Partial voting teciiniqiic 



25 



III. ALGORITHM IMPLEMENTATION 



From the discussion of the previous chapter the affine transformation is known to 
be a ver\’ effective method for object detection at different views, although a great deal 
of computation is needed in the process. This makes the affine transformation technique 
impractical unless the complexity can be reduced. Hence, the algorithm was divided into 
two steps. The first step is the preprocessing at which data-base representation of 
models is built. This step does not involve any information from the test scene. It is 
executed off-line before the recognition. The second step is the recognition at which the 
data-base is used to match the models against the test objects. With the suggested 
two-step scheme, it is possible to keep the complexity of on-line computations low. As 
discussed in the previous chapter it is necessarx' to solve some major problems of the 
algorithm, such as the basis instability, the collision of the hash table, and the noise 
sensitivity. The solutions to these problems were proposed. The implementation of this 
improved two-step algorithm is discussed in the following. The Pascal source code of 
all modules is listed in Appendix ,>\. 

A. PREPROCESSING (DATA-BASE SETUP) 

This off-line step has four modules which are explained separately. The operations 
of the preprocessing step are shown in Figure 10. 

1. Rule Out the Undesired Triplets 

This module solves the numerical instability problem by ruling out the trouble- 
some triplets. The following procedures are included. 



26 




Figure 10. Fl()^vchart of the preprocessing step 
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a. COMBINA TION 



This is a recursive procedure which generates all possible combinations of 



triplets from a set of input interesting points. If there are m interesting points, the total 
number of combinations will be 



For each combination generated this procedure will call the SELECTION procedure. 
b. SELECTION 

This procedure screens the triplet passed from the COMBINATION pro- 
cedure. If the area of this triplet is less than one twentieth of the corresponding model 
area, it will be bypassed and the control returned to the COMBINATION procedure for 
a new triplet. If the triplet area is greater than or equal to this value, then the control 
will go to the PERML'T.ATION procedure. Since a triplet passing the area test is also 
a non-collinear set, no additional collinearity test is necessary in this procedure, 
f. PERMUTA TION 

The order of points of the selected triplet is important, because a different 
order of the same triplet can generate different affine coefficients. Hence, this procedure 
considers all the permutations of the selected triplet, i.e., every’ triplet has P\ — 6 per- 
mutation cases. 

2. Calculation of Affine Coefficients 

For a given triplet <a, b, c>, this module calculates the affine coefficients 
{t, 7]) of all other points p, based on this triplet, that is 



r” 



.m 



m{m — l)(m — 2) 



(3.1) 



3! 




(3.2) 



2S 



where /= 1, 2, 3 , m — 3. 

According to the above equation this module includes several matrix operation 
modules. The INVERSE computes the inverse matrix in the equation, and the 
MATRIX-MULT multiplies this inverse matrix with the other matrix to get the affine 
coefficients ^ and rj. 

3. Quantization of the Affine Plane 

In order to tolerate the noise perturbation, a 90 x 90 table-size was used based 
on the previous discussion. This means that the affme plane can be divided into 8100 
different bins, where each bin is indexed by (i, j). Two procedures are called in this 
module, namely, SCATTER and QUANTIZATION. 
a. SCATTER 

Before quantization, an atan was used as the hashing function. This special 
function can scatter the affine coefficients (f and r; over a wide range in the affme plane 
to avoid the collision in hash table due to the concentration of affine coefficients. So, 
the scattered afime coefficients are 



b. QUANTIZA TION 

From equations (2.12), (2.13), and the assumed values of A. it is possible 
to calculate the bounds on the affine coefficients. Since a 90 x 90 table-size was used, 
the quantization index (i. j) for all affme coefficient pairs (i, ?/) can be calculated as in 
the following : 



c = atan{t) 



(3.3) 



)] = aian{ii). 



(3.4) 




(3.5) 
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(3.6) 
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for A-1 >0 



/ = u-unc{k 1) + 46 



for Ai < 0 



/ = rn/«c(A 1) + 45 



(3.7) 



(3.8) 



for A2>0 



j = trunc{k2) + 46 



(3.9) 



for A2<0 



j = trunc{k2) + 45. 



(3.10) 



4. Hash Table Generation 

The purpose of this module is to create a hash table which can be stored in the 
data-base to identify the test objects from the scene. There are three procedures in this 
module as detailed below. 



30 



a. KEY-CONVERSION 



Since the two-dimensional index (i, j) is not a numeric key, it can be con- 
verted into a numeric form for the convenience of implementation. The conversion 
should be done with the least collision of entry and without losing information in the 
key. Equation (3.1 1) was selected to meet the above requirements. This procedure uses 
it to generate the inkey. 

inkey = rri/rtcQ/ x tan 30° +jx- tan 20°) x 100]. (3-11) 

In a good hash table, the inkey should be distributed as evenly as possible 
over the range of the table size. The KEY-CONVERSION procedure uses the simple 
method of division to convert the inkey to a hashkey, i.e., 

hashkey = inkey rent N. (3-12) 

where rem is the operation of reminder and N is the prime number that is approximately 
equal to or less than the size of the hash table. 

b. HASHING 

To setup the hash table, all the records of interesting points have to be put 
into the table as entries and each record with the same inkey will be linked by pointers. 
The HASHING procedure checks to see whether the entr>’ in the hash table accessed 
by the hashkey is empty. If it is, then insertion of this input record into the hash table 
will be done right away. Otherwise, it will invoke the COLLISION procedure. 

c. COLLISION 

The link field of ever\’ entr\' in the hash table indicates whether the entr>' is 
occupied or not. If the entry' is empty, its link field was set to -1. If the accessed entry' 
in the hash table is not empty, this procedure will find the next available slot for the in- 
put record. Then, it will put the relative address (hashkey) of the new slot into the link 
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field of the previous one which has the same inkey. After all the records are entered, the 
hash table linked by pointers is established. Figure 1 1 illustrates the structure of the 
hash table. 

B. RECOGNITION (IDENTIFICATION OF TEST OBJECTS) 

After the preprocessing step is accomplished, a set of interesting points of the test 
objects can be processed to identify the unknown objects in the recognition step. There 
are three modules involved in this off-line step. The operation of the recognition step 
is shown in Figure 12. The following is a discussion of these steps. 

1. Calculation of Input Data 

This step is similar to part of the preprocessing step e.xcept that there is a dif- 
ference in the hash table. Here, only input affine coefficients based on stable basis 
triplets need to be calculated. Since the noise perturbation is inevitable in the input 
image, sensitivity is an important issue here. In order to ensure the tolerance to a noisy 
environment, the criterion factor 1 20 of the area in the SELECTION procedure of the 
preprocessing step was replaced by the factor 1,T0. The triplet area should be at least 
I'lO of the total area of the test object, otherwise the triplet will be rejected. The output 
of this module is a data file called tally. Figure 13 shows the structure of the tally file. 

2. Affine Matching 

This matching module is an important part in the recognition procedure. Partial 
voting technique was implemented to generate all the candidate data. The following is 
a discussion of the procedures included in this module. 
a. PARTIAL VOTING 

For a given interesting point, this procedure checks all the nearby affine 
coefficients in the tally file. After quantization, everv' affine coefficient pair (c , t}) be- 
longs to a corresponding bucket indexed by (i, j). Therefore, the matching procedure is 
nothing but a mapping between the tally file and the hash table. If there is a match, 
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Figure 12. FloAvchart of the recogniton step 
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TALLY FILE RECORD 



Figure Slrudtire of the tally data file 
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even’ entn associated with the bucket (i, j) will receive one vote. Since the partial voting 
technique was used to tolerate the noise perturbation, the eight neighbors of the bucket 
( i , j ) will receive partial votes, i.e., entries associated with buckets (i-1, j-1), (i-1, j+ 1), 
(i+ 1. j-1) and (i+ 1, j+ 1) will receive a 0.25 vote; entries associated with buckets (i-1, 
j). (i, j-1), (i, j+ 1) and (i-1- 1, j) will receive a 0.5 vote. 

When all the entries in the tally file are matched in the procedure, the cor- 
responding voting array of the affine coefficient pair will accumulate all the votes it has 
gotten during the campaign. In ideal noise-free case, the entry that received the maxi- 
mum votes indicates an exact matching between the test object and the data-base model. 
But in the noisy case, the result is different. In the latter case partial voting technique 
was applied to reduce the noise perturbation problem. It is evident that some voting 
array bins will receive extra votes due to the multiple voting. Some false peaks may 
appear in the voting array as the by-product of the partial voting technique. Therefore, 
the entry which received the maximum votes may not be the desired candidate. This 
kind of problem will be treated in the following procedures. 
b. TOP-SIX- MAX 

One way to solve the false peak problem is to conduct additional tests on 
all the entries after partial voting. But, it is impractical because of the long processing 
time. Another approach is proposed based on the fact that the false entries may some- 
times receive maximum vote, but the true ones should have votes close to the false peak. 
Based on the experimental experience, the first six highest number of votes are chosen 
to select the suited entries in the hash table. This procedure essentially finds the top six 
maximum number of votes. 
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c. ALL-MAX-SELECTION 



In this procedure all the entries which satisfy the above criterion will be se- 
lected. Since only a small amount of entries will be checked instead of all the ones in the 
next procedure, this method can save a lot of operation time in the recognition step. 
d. CHECK 

This CHECK procedure will test all the entries sent from the 
.MAX-SELECTION procedure. After all the redundant entries are deleted, the appro- 
priate ones are picked by going through a TEST sub-procedure included in th's module. 
The qualified entries can be considered as the candidate data. 

3. RECONSTRUCTION 

This module does the inverse affine transformation to calculate all the interest- 
ing point sets of the qualified candidate triplets. 

4. VERIFICATION 

Since not all the candidate interesting point sets are correct, the purpose of this 
module is to check all those interesting point sets until finding the correct one. Finally, 
the identified images will be displayed on the screen. 



37 



IV. EXPERIMENTAL RESULTS AND PERFORMANCE 



Presented in this chapter are the computer simulation results and the experimental 
performance of the improved afilne invariant matching algorithm. These experimental 
tests reconfirmed the affine invariance of this algorithm. It also showed the improved 
noise characteristic which is the main problem of the original algorithm. Since our study 
is concentrated on the algorithm improvement, models and test objects were generated 
artificially in the computer. There are two different sets of data used in the experiments. 
For the convenience of explanation, the first set is referred to as SETl which consists 
of two simple objects, and the second one is referred to as SET2 which consists of two 
complicated objects. Figure 14 shows these two sets of models. 

A. NOISE-FREE TESTS 

First, an ideal noise-free situation is considered. The model objects in SETl and 
SET2 are undergone similarity transformation. Occlusion is also evident in the test ob- 
jects. The main objective is to check the affine invariant characteristics of the algorithm, 
i.e., rotation, translation, and scaling. The ability to detect occluded object will also be 
tested. 

1. Similarity Transformation Test 

The unknown test object of SETl is used as the input of the algorithm. The test 
object and the recognized object of SETl are shown in Figure 15. Figure 16 shows the 
same kind of test for SET2. This is a case where the recognition of models from the test 
objects with rotation, translation, and scaling are demonstrated. 

2. Occlusion Test 

A composite overlapping scene consists of two different test objects can be 
identified through the affine invariant matching algorithm. Furthermore, one vertex 
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Figure 14. Data-base models of SETl(above) and SET2(beIoAv) 
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Figure 15. Similarity transform test ofSEI l 
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riglire 16. Similarity transform test of SET2 
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point of the polygonal shape is missing for the test objects of SETl shown in 
Figure 17. Two polygonal vertices for the test objects of SET2 are also missing in Fig- 
ure 18. The test results of SETl and SET2 are also shown at the bottom in Figure 17 
and Figure 18, respectively. From the reconstructed results of SETl and SET2, it is 
obvious that the hidden vertices of the test objects in both cases can still be recognized 
because of the special characteristic of the algorithm. 

B. NOISE PERTURBATION TESTS 

In this section the test objects will be identified in scenes with noise perturbations. 
In usual situations a filter can be applied to remove most of the noise. But in reality, 
some vertex points will still have small errors after the extraction procedure. It was 
noted in the previous chapters that the afTine invariant matching algorithm was very 
rigid in calculating the coefficients ^ and t]. If the coordinates of some vertex points 
changed a little in the presence of noise, the affine coefficients based on these noisy co- 
ordinates would deviate from the true positions in the affine plane. Even if the error of 
the extraction is ver>' small, it can cause the original recognition step to fail. This is due 
to the erroneous matching occurred in the hash table. 

The tests conducted in this section showed the noise tolerance of the improved al- 
gorithm. According to the limits of the the affine plane resolution and the mask size of 
the partial voting, the allowable maximum error in the vertex extraction is about ~J2 . 
This means that the error region of the interesting point is a circle with a center on the 
point and a radius equals to v 2 shown in Figure 19. The variation of the vertex 
may fall inside or on the circle. In the following tests only the worst cases are consid- 
ered, i.e., the test objects are occluded and some of its interesting points are disturbed 
by the noise. 

Figure 20 shows the plot of the test objects of SETl with four interesting points 
disturbed. Figure 21 shows the recognition of SETl with four interesting points dis- 
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Figure 17. Occluded objects test of SC TI 
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rigni e l.S. Occluded objects test of SET2 





rij^uie 19. Error region of the liistiirbed interesting point 
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Figure 20. Plot of tlie test objects of SETl >>ith four interesting points disturbed 
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m MCOGHIZCO OBJECTS 




Figure 21. Recognition of SE I l \\illi four interesting points disturbed 
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turbed. Figure 22 shows the plot of the lest objects of SET2 with six interesting points 
disturbed. Figure 23 shows the recognition of SET2 with six interesting points dis- 
turbed. Figure 24 shows the plot of the test objects of SET I with seven interesting 
points disturbed. Figure 25 shows the recognition of SETl with seven interesting points 
disturbed. Figure 26 shows the plot of the test objects of SET2 with ten interesting 
points' disturbed. Figure 27 shows the recognition of SET2 with ten interesting points 
disturbed. 

C. PERFORMANCE 

By inspecting the results of our experimental tests, it is evident that almost all of the 
limitations of the original affine matching algorithm have been improved. The old 
problems include the numerical instability, the collision of hash table, and the noise 
sensitivity. Since the modified hash structure was used, the problem of hash table colli- 
sion due to nonuniform hashkeys was greatly reduced. Consequently, about 1300 ms 
of CPU time was saved in the recognition step of the noise free tests. Initially, the ori- 
ginal algorithm is very sensitive to noise and fails in noisy tests. In order to increase the 
tolerance to noise perturbation, a quantized aflme plane with 90 x 90 resolute cells was 
chosen. After the quantization, the partial voting technique was also used to select all 
the qualified candidate triplets. Finally, in the verification procedure the identified 
object(s) was displayed on the screen. For the improved algorithm the noise tolerance 
is enhanced by a factor of 70° o, i.e., even when seventy percent of the interesting points 
of the test object are disturbed, the improved algorithm can still identify the test objects. 

There is a trade-off between the processing speed and the noise tolerance. To have 
more noise tolerance, the partial voting technique is used. This will decrease the speed 
and increase the complexity of the algorithm. Therefore, the processing speed of the 
improved algorithm is still highly dependent on the number of interesting points in the 
test object. Another existing limitation of the algorithm is that only objects with small 
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Figure 22. Plot of the test objects of SE T2 Mith sL\ interesting points disturbed 
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Figure 23. Recognition of SET2 uitli sLx interesting points disturbed 
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□ original test objects 




Figure 24. Plot of the test objects of SETl A^ith seven interesting points disturbed 
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Figure 25. 
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Figure 26. Plot of the test objects of SET2 >>itli fen interesting points disturbed 
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Figure 27. Recognition of SET2 ten interesting points disturbed 
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number of vertices are handled here. Additionally, the system developed here can not 
be applied to patterns with concave boundary curves. However, the algorithm can be 
extended in these cases by using the footprint method proposed by Hummel and 
Wolfson [Ref 3]. 

D. EXPERIENCE GAINED 

The experience gained in this study can be summarized as follows. 

1. Numerical Instability 

When the interesting points of a triplet are too close to each other, the affine 
coefficients calculated based on this triplet tend to be unstable. This undesirable situ- 
ation can be avoided by applying the area test criteria in both the Preprocessing and the 
Recognition steps. 

2. Hashing Function 

The values of c and rj tend to concentrate highly around the origin of the affine 
plane because they are all small numbers. These small-valued coefficients will generate 
many long linked lists in the hash table. Hence, the accessing time will increase and 
become impractically long. Both the linear and non-linear hashing functions were tested 
in the experiments. The results show that the non-linear atan function is the best among 
many hashing functions. This function can scatter the small afline coefficients evenly 
over a wide range of the affine plane. Consequently, the size of the linked list can be 
reduced and a desirable processing speed can be achieved. 

3. Quantization of Affine Plane 

In order to tolerate the noise perturbation on the test objects, coarser 
quantization of affine plane is desirable. After calculating the bounds on <f and ?/, an 
appropriate table size was chosen to implement the hash table. But, there is no optimal 
hash table size that can work well for all kinds of data. In our experimental tests a 90 
X 90 table size was selected. 
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4. Modified Hash Structure 



After quantization, every entry in the hash table is indexed by (i, j). This tvvo- 
dimentional index is not a numeric key, it needs to be converted into a numeric value to 
implement the one-dimentional hash table. However, this kind of conversion will induce 
multiple collisions in the hash table. In order to reduce these collisions, two different 
one-to-one functions were adopted to generate the numerical inkey. 

5. Partial Voting Technique 

The noise problem can be lessened by using a coarser quantization of the affine 
plane. In addition, it is possible to improve the original matching algorithm by applying 
the partial voting technique. For every quantized affine index (i. j), there is a corre- 
sponding eight-neighbor mesh where each bin has a different voting weight. This tech- 
nique can increase the noise tolerance in the recognition step. 

6. False Peaks of Voting Array 

As a result of the partial voting, the aflnie invariant matching algorithm suffers 
from the false peaks in the accumulation array. The entry which received the maximum 
votes may not be the correct one. To overcome this problem, the top six maximum 
votes are chosen as the candidates. By going through the verification procedure the 
correct candidate can be selected. 

7. Noise Perturbation 

The original algorithm is very rigid in calculating the affine coefficients. Hence, 
it is ver\' sensitive to noise perturbation. From the experimental results of the improved 
algorithm, the noise tolerance shows an increase of 70% with respect to the original 
method. 

8. Speed and Complexity 

In noise free cases, the improved matching algorithm can achieve a higher speed 
than the original one when dealing with more complicated images. In noisy cases, the 
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speed deteriorates due to the execuation of partial voting. But, in both cases the 
execuation time of the improved algorithm is still highly dependent on the number of 
interesting points involved in the test. 
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V. CONCLUSIONS AND FUTURE RESEARCH 



The object recognition is a major and difTicult task in computer vision. The afiine 
invariant matching technique proposed by Hummel and Wolfson is a new and interest- 
ing method for recognizing flat objects in a perspective projection image. Since the re- 
cognition of partially occluded objects is the main concern, the local point feature was 
used in the affine invariant matching algorithm. In order to reduce the’complexity of 
the algorithm, a two-step scheme was applied. The algorithm was divided into two dif- 
ferent steps, the off-line preprocessing step and the on-line recognition step. 

This thesis discusses the shortcomings that occurred in the original algorithm. They 
are the basis instability, the collision of hash table, and the noise problem. These 
shortcomings make the original matching algorithm impractical to deal with real images. 
The original algorithm was improved by introducing several modifications. The area test 
criteria were used to get rid of unsuitable triplets to avoid numerical errors. The modi- 
fied hash structure clearly improved the collision problem of the hash table. The partial 
voting technique with the consideration of false peaks in the voting array increased the 
noise tolerance of the original algorithm. Finally, it was shown that the results obtained 
from the improved algorithm are much better than the results from the original method. 

Possible subjects for future study related to affine invariant matching could be : 

• From the probability point of view, set up an optimal model to improve the re- 
cognition performance for noisy objects. 

• Use the footprint method to implement the affine invariant curve matching. 

• Extend the afiine invariant matching to handle 3-D object recognition. 
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• Design special purpose hardware to achieve parallel searching of multiple objects 
in real time. 
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APPENDIX A. PASCAL SOURCE CODE 



This appendix contains the Pascal source code used in the improved affine matching 
system. Explanation of each of the modules are discussed in Chapter III. Some proce- 
dures in these programs are adapted from the original implementation [Ref. 6]. 

PR£ PROCE SSI NG ********’>V**-5V*'jV**Vc’“V*’3V*3V*'3V****5V**tV‘>V'>V 
Vf *5VVf****Vr* **************** (Off-line St ep ) **'*’>v*************************** 



program model_gen(output); 

(* This module generates the interesting points of data-base models, 
SETl is used as the example *’’0 
(* o/p : model_interesting_point data file *) 
type 

ary = array [1.. 2,1. ,50] of integer; 
var 

i, j ,modelno, interestingno : integer; 

output : text; 
x,y : ary; 
begin 

open( output, *model_interesting_point. dat' , history := new); 
rewriteC output); 



' model 


1 *) 














modelno 


:= 1; 


interestingno 


:= 9; 








x[ 1,1] 


= 32; 


x[l,2] 


:= 36; 


x[ 1,3] 


:= 38; 


x[l,4] 


:= 40; 


x[l,5] 


= 48; 


x[l,6] 


:= 50; 


x[ 1,7] 


:= 52; 


x[ 1,8] 


:= 56; 


x[l,9] 


= 44; 














y[i,i] 


= 30; 


y|i,2] 


:= 30; 


y| 1.3] 


:= 28; 


y[ 1.^] 


:= 30; 


y[i,5] 


= 30; 


y[i,6] 


:= 28; 


y[i,7] 


.-= 30; 


y[i,8] 


:= 30; 


y[i,9] 


= 62; 














wr it eln( output , modelno , interestingno); 






for i : = 


= 1 to 


interestingno 


do 








writelnC output ,x[ 1, 


i] .y[ 1 


,i] ); 








' model ; 


2 *) 














modelno 


:= 2; 


interestingno 


:= 7; 








x[2,l] 


= 20; 


x[2,2] 


:= 21; 


x[2,3] 


:= 21; 


x[2,4] 


:= 25; 


x[2,5] 


= 15; 


x[2,6] 


:= 19; 


x[2,7] 


:= 19; 






y[2,i] 


= 31; 


y[2,2] 


;= 32; 


y[2,3] 


:= 40; 


y[2,4] 


:= 50; 


y[2,5] 


= 50; 


y[2,6] 


:= 40; 


y[2,7] 


:= 32; 







wr it eln( output , mode Ino , interestingno); 
for i : = 1 to interestingno do 
writeln(output ,x[ 2, i] ,y[ 2, i] ); 
close(output); 
end. 



program model_af f ine_calculation( input , output); 

(* This module rules out the undesirable triplets and finds all the 
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affine coefficient pair of data-base models *) 

(* i/p : model_interesting_point data file 

o/p : model_af f ine_coef f icient data file *) 
const 

total = 9999; 
areal = 392. 0; 
area2 = 76. 0; 
type 

ary = array [ 1. . total] of integer; 
aryl = array [1..2,1..2] of real; 
ary2 = array [ 1. . 3] of integer; 
ary3 = array [1..2,1..1] of real; 
ary4 = array [1..2,1. .2] of integer; 
var 

count ,i,j ,k, index : integer; 

outmodelno, out interest ingno : array [ 1. . 10] of integer; 

modelno, trip letno, inter estingno, tab le_size : integer; 

x,y,rest_basex,rest_basey : ary; 

inverse_matrix : aryl; 

baseXjbasey, comx, corny : ary2; 

diff, coord : ary3; 

base_matrix : ary4; 



procedure matrix_mult( inverse_matrix : 

var diff, coord : 



const 



aryl; 

ary3); 



k = 2; 

1 = 2; 
m = 1; 
var 

i,il,n : integer; ' 
begin 

for i : = 1 to 1 do 
for il := 1 to m do 
coord[ i, il] : = 0; 
for i : = 1 to 1 do 
for il : = 1 to m do 
for n : = 1 to 1 do 

coord[i,il] := coord[i,il] + inverse^matr ix[ i ,n] 
diff[n,il] ; 

end; 



* 



procedure inverse(base_matrix : ary4 



var invers( 

var 

det : real; 
begin 

for i : = 1 to 2 do 

det ;= (base_matrix[ 1 , 1] 
(base_matrix[ 1,2] 
if (det <> 0.0) then 
begin 

inverse_matrix[ 1,1] : = 
inverse_matrix[ 1,2] := 
inverse_matrix[ 2,1] : = 
inverse_matrix[ 2,2] : = 



‘^matrix : aryl); 



* base_matrix[ 2, 2] ) - 

* base_matrix[ 2, 1] ); 



base_matrix[ 2,2] /det; 
base_matrix[ 1 ,2] * (-1) /det; 
base_matrix[ 2, 1] * (“1) /det; 
base_matr ix[ 1 , 1] /det; 
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end; 

end; 

procedure calculate_coord(basex,basey : ary2); 
var 

i,m,il,i2,i3 : integer; 
begin 

for i := 1 to 2 do 
begin 

base_matrix[ 1 , i] := basex[ i] - basex[ i+1] ; 
base_matrix[ 2 , i] := basey[ ij - basey[ i+1] ; 
end; 

inverse(base_matrix, inverse_matr ix) ; 
i2 := 1; 

for i : = 1 to interest ingno do 
begin 

if ((basex[lj <> x[ i] ) or (basey[ 1] <> y[i])) and 
((basex[2] <> x[ i] ) or (basey[2] <> y[i])) and 
((basex[3j <> x[ i] ) or (basey[3] <> y[i])) then 
begin 

rest_basex[ i2] := x[ i] ; 
rest_basey[ i2] := y[ ij ; 
i2 := i2 + 1; 
end; 

end; 

for i : = 1 to ( interestingno[ 3 ) do 
begin 

diff[l,l] := rest_basex[ i] - basex[3j; 

diff[2,lj := rest_basey[ i] - basey[ 3] ; 

raatrix_mult( inverse_matrix,dif f , coord); 

count := count +1; 

i3 := count mod ( interestingno-3); 

if i3 = 1 then tripletno := tripletno + 1; 

write( output , mode Ino , tripletno , coord[ 1,1], coord[ 2,1] ) ; 
for il := 1 to 3 do 

write(output ,basex[ il] ,basey[ il] ); 
write ln( output); 

end; 

end; 

procedure perm(basex ,basey : ary2; 

k : integer); 

var 

i,tx,ty : integer; 

begin 

if k = 3 then 

calculate_coord(basex,basey) 

else 

for i : = k to 3 do 
begin 

tx : = basex[ i] ; 
ty : = basey[ ij ; 
basex[ i] := basex[k]; 
baseyi ij := basey[kj; 
basex[kj := tx; 
baseyi kj : = ty; 
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pe rm( bas ex , bas ey , k+ 1 ) ; 
end; 

end; 

procedure area_test( comx, corny : ary2; i : integer); 

var 

s ,a,b,CjSarea,area ; real; 
begin 

a := sqr(comx[ 2] [ comx[ 1] )+sqr(comy[ 2] ] comy[ 1] ); 

b := sqr(comx[ 3] [ comx[ 2] )+sqr(comy[ 3] ] comy[ 2] ); 

c : = sqr( comx[ 1] [ comx[ 3] )+sqr( comy[ 1] ] comy[ 3] ) ; 

a := sqrt(a); 
b := sqrt(b); 
c : = sqrt(c); 
s := (a + b + c )/2.0; 
if i = 1 then area : = areal; 
if i <> 1 then area := area2; 
sarea := s*(s-a)*(s-b)*(s-c); 
sarea := sqrt(sarea); 
area : = area/20. 0; 
if (sarea > area) then 
perm( comx , corny , 1 ) ; 

end; 



procedure comb(k, index, j : integer); 

var 

i : integer; 
begin 

if index > 3 then area_test( comx, corny , j ) 
else 

for i : = k to interestingno do 
begin 

comx[ index] : = x[ i] ; 
comy[ index] : = y[ i] ; 

j •= j; 

comb( i+1 , index+1 , j ) ; 
end; 

end; 

beginC’^ main *) 

open( input , *model_interesting_point. dat^history := old); 
reset( intput ); 

open( output , *model_affine_coefficient. dat* , history := new); 
rewr it e( output ) ; 
table_size := 0;j:= 1; 
while not eof( input) do 
begin 

readln( input ,outmodelno[ j] ,outinterestingno[ j] ); 
modelno := outmodelno[ j] ; 
interestingno : = outinterest ingno[ j] ; 
for i : = 1 to interestingno do 
readln( input ,x[ i] ,y[ i] ); 
count : =0; tripletno := 0; j := j+1; 
comb( 1, 1 , modelno); 
table_size ;= table_size + count; 
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end; 

writelnC output ,table_size,outmodelno[ 1] , outinterestingno[ 1] , 
outmodelno[ 2] jOutinterestingno[ 2] ); 
close( input); 
close( output) ; 
end. 






program model_inkey( input , output) ; 

(* This module quantizes the affine plane into 8100 different bins and 
converts each bin index (i, j) to an inkey *) 

(* i/p : model_af f ine_coef f icient data file 
o/p ; inkey data file *) 
type 

inrec = record 

modelno , tripletno : integer; 

keyl,key2 : real; 

basexl jbaseyl ,basex2 ,basey2 ,basex3 jbaseyS : integer 
end; 

var 

b : inrec; 

inf ile,outf ile : text; 

kl,k2,dk, inkey 1 : real; 

i , j j il , j 1 , size jprim, inkey : integer; 

procedure prime(var a : integer); 
var 

i,b : integer; 

begin 

b : = trunc(a/2); 
for i : = 2 to b do 
begin 

if (a mod i) = 0 then 
begin 

a : = a-1; 
prime( a) ; 
end; 

end; 

end; 

begin(* main *) 

open ( input , ' model_af f ine_coef f icient. dat ' , history: =old); 
reset( input) ; 

open ( output , ' inkey. dat * , history: =new) ; 
rewrite(output) ; 
jl :=0; 

while not eof( input) do 
begin 

readln( input); 
jl := jl+1; 
end; 

close( input) ; 

open (input, ’ model_af f ine_coef f icient. dat* , history: =old); 
reset( input); 
il := 1; 
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dk := 2. 0*arctan(20. 0)/90. 0; 
size : = j 1 - 1; 
prim := size; 
prime(prim); 

wr it eln( output , s ize , pr im) ; 
while il <> jl do 
with b do 
begin 

readln( input ,modelno ,tripletno , keyl ,key2 , 

basexl ,baseyl ,basex2 ,basey2 ,basex3 ,basey3); 
kl := arctan(keyl)/dk; 
k2 := arctan(key2)/dk; 
if (kl >= 0. 0) then 
begin 

i := trunc(kl) + 46; 
if (i > 90) then i := 90; 
end; 

if (kl < 0. 0) then 
begin 

i := trunc(kl) + 45; 
if ( i < 1) then i : = 1; 
end; 

if (k2 >= 0.0) then 
begin 

j := trunc(k2) + 46; 
if (j > 90) then j := 90; 
end; 

if (k2 < 0. 0) then 
begin 

j := trunc(k2) + 45; 
if ( j < 1) then j : = 1; 
end; 

inkey 1 := (0. 839*i + 0. 364*j )*100; 
inkey := trunc( inkeyl) ; 

write ln( output , inkey, ' * : 2 , i: 2 , ’ ’ : 2 , j : 2 ,raodelno: 2 , 

tripletno,keyl ,key2 ,basexl ,baseyl ,basex2 , 
basey2 ,basex3 ,basey3); 
il := il+1; 
end; 

close( input); 
close(output); 



end. 






program hashing( input , output); 

(* This module uses the inkey to generate the hashkey and sets up 
the hash table *) 

(* i/p : inkey data file 

o/p : hash_table data file *) 
const 

database_modelno = 2; 
type 

rec = record 

inkey , i , j ,modelno,tripletno, link : integer; 

keyl,key2 : real; 
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basexl jbaseyl ,basex2 ,basey2 ,basex3 ,basey3 : integer; 
end; 

outrec = record 

hashkey , inkey , i , j , mode Ino , t r ipletno , 1 ink : integer; 
keyl,key2 : real; 

basexl ,baseyl,basex2 ,basey2 ,basex3,basey3 : integer; 
end; 

var 

a : array[ 0. . 99999] of outrec; 
b : rec; 

il , i2 ,j 1 ,j2,k2 , tablets ize, prim : integer; 

outmodelno,outinterestingno : array [ 1. . database_modelno] of integer; 
c : array[ 0. . 99999] of integer; 

procedure print; 
var 

i2 : integer; 
begin 

for i2 : = 0 to table_size - 1 do 
begin 

if a[ i2] . hashkey <> - 1 then 
with a[ i2] do 

write ln( output , hashkey , inkey , ' * ; 2,i: 2 , * ’ : 2, j: 2, ' ’ : 2, 
mode Ino: 2, tr ipletno: 4,keyl , key 2 , basexl: 4, 
baseyl: 4,basex2: 4,basey2: 4,basex3: 4,basey3: 4, link) 

end; 

end; 



I'ocedure collision( var m,n : integer); 
begin 

while a[m].link <> - 1 do 
m : = a[ m] . link; 
n : = m + 1 ; 

while a[n]. hashkey <> - 1 do 
begin 

n : = n+1; 



if n > table_size - 1 then n : = 0 
end; 

a[ m] . link : = n; 
a[ n] . hashkey : = n; 
a[n] 
a[n] 
a[n] 
a[n] 

a[ n] . tripletno := b. tripletno; 
a[n].keyl := b. keyl; 
a[n].key2 := b. key2; 

b. basexl; 



inkey : = b. inkey; 
i : = b. i; 
j : = b. j; 

modelno := b. modelno; 



a[ n] . basexl 
a[ n] . baseyl 
a[ n] . basex2 
a[ n] . basey2 
a[ n] . basex3 
a[ n] . basey3 
end; 



b. baseyl; 
b, basex2; 
b. basey2; 
b. basex3; 
b. basey3; 
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procedure initialize; 
var 

il : integer; 

begin 

for il : = 0 to table_size - 1 do 
begin 

a[ il] . hashkey := - 1; 
a[ il] . link : = - 1; 
c[ il] : = 0; 
end; 

end; 

procedure insert(var m,n : integer); 
begin 

if ( a[ m] . hashkey = - 1) then 
begin 

a[ m] . hashkey : =m; 
a[mj. inkey := b. inkey; 
a[ mj . i : = b. i; 
a[m] . j : = b. j; 
a[ m] . modelno := b.modelno; 
a[ m] . tripletno := b. tripletno; 
a[m].keyl := b. keyl; 
a[ m] . key2 : = b. key2; 
a[m].basexl := b. basexl; 
a[m].baseyl := b. baseyl; 
a[m].basex2 := b. basex2; 
a[m].basey2 := b. basey2; 
a[m].basex3 := b. basex3; 
a[ mj . basey3 : = b. basey3; 
c[nj := 1; 
end; 
end; 

begin (* main *) 

open ( input / inkey. dat^ , history := old); 
reset( input); 

open (output , *hash_table. dat* jhistory := new); 
rewrite(output ) ; 
readln( input , table_size ,prim) ; 
writelnC output , tab le_size , prim); 
initialize; 
il :=0;jl := - 1; 
while not eof( input) do 
begin 

with b do 
begin 

readln( input, inkey, i, j ,modelno, trip letno, keyl ,key2 , 
basexl , baseyl ,basex2 ,basey2 ,basex3 ,basey3); 
il := inkey rem prim; 
end; 

jl := jl + 1; 
insert(il, jl); 
end; 

close( input); 

open (input inkey. dat\ history := old); 
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reset( input); 
i2 := 0; j2 : =- 1; k2 := 0; 
readln( input , tab le_size , prim) ; 
while not eof( input) do 
begin 

with b do 
begin 

readln( input , inkey, i , j ,modelno , tripletno , keyl ,key2 , 
basexl ,baseyl ,basex2 ,basey2 ,basex3 ,basey3); 
i2 : = inkey rem prim; 
end; 

j2 := j2 + 1; 
if c[ j2] =0 then 
collision( i2 ,k2); 

end; 

close( input); 
print; 

close(output); 

end. 



VfVrVc’>V'>V*'5V’»V‘5V*'5V*’»V’»V^V*'/V')V'5V*’»V“VVc'’>V^VVc’ RECOGNITION *'»V'>V'5V*'>V’5V*';V'5V')V’>V^VVf^V:>V'5V'3V7V'jV’>V’5V‘»V’>V7V’>V*'>V'>V*'»V'>V'»V'>V 
Vr5V7V’>Wf’>V’»v-jV’>v*’»V’»V'»V';V’»V’>Wf'>V’»V’>v->Wc’9V'5V^v ( On* line Step) 



program test_gen( output ); 

(* This module generates the interesting points of test objects *) 

(- o/p : test_interesting_point data file *) 

type 

ary = array [1., 2,1.. 50] of integer; 
var 



i, j ,modelno, interestingno : integer; 
x,y : ary; 
begin 

open( output , * test_interest ing^point. dat * , history 
rewrite( output); 
test object -) 



( 



= new); 



modelno 



= 1; interestingno : = 10; 



X[ 


1,1] 


= 50; 


x[ 1; 


.2] 


= 40; 


x[ 


1,3] 


:= 30; 




X[ 


1,4] 


= 10; 


x[ 1; 


.5] 


= 10; 










X[ 


1,6] 


= 20; 


x[ 1; 


,7] 


= 30; 


x[ 


1,8] 


:= 30; 


x[l,9] := 40; 


X[ 


1,10] 


:= 40; 
















y[ 


1,1] 


= 10; 


y[i. 


.2] 


= 0; 


y[i 


,3] : 


= 10; 




y[ 


1,4] 


= 10; 


y[i. 


.5] 


= 40; 










y[ 


1,6] 


= 40; 


y[i. 


.7] 


= 50; 


y[ 


1,8] 


:= 30; 


y[l,9] := 30; 



y[l,10] := 20; 

writeln( output , modelno , interestingno); 
for i : = 1 to interestingno do 
writeln( interest ing,x[ 1, i] ,y[ 1 , i] ); 
close(output); 
end. 



..u , 



***** 






************************************* 



program test_af f ine_calculation( input , output ); 

(* This module rules out the undesirable triplets and finds all the 
affine coefficient pair of test objects *) 

(* i/p : test_interesting_point data file 
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o/p : test_af f ine_coef f icient data file *) 

const 

total = 9999; 
tarea = 533. 0; 
type 

ary = array [ 1. . total] of integer; 
aryl = array [1. .2,1. .2] of real; 
ary2 = array [ 1. . 3] of integer; 
ary3 = array [1. .2,l..l] of real; 
ary4 = array [1..2,1..2] of integer; 
var 

count ,i,k, index : integer; 

modelno, interest ingno ,table_s ize : integer; 

x,y ,rest_basex,rest_basey : ary; 

inverse_matrix : aryl; 

bas ex, basey,comx, corny : ary2; 

diff, coord : ary3; 

base_matrix : ary4; 



procedure test_matrix_mult( inverse_matrix : aryl; 

var diff, coord : ary3); 

const 

k = 2; 

1 = 2; 
m = 1; 
var 

i, j ,n : integer; 

begin 

for i : = 1 to 1 do 
for j : = 1 to m do 
cord[ i, j] : = 0; 
for i : = 1 to 1 do 
for j : = 1 to m do 
for n : = 1 to 1 do 

coord[i,j] := coord[i,j] + inverse_matrix[ i,n] 
diff[n, j] ; 

end; 



procedure test_inverse(base_matrix : ary4; 

var inverse_matrix : aryl); 



var 

det : real; 
begin 

for i : = 1 to 2 do 

det := (base_matrix[ 1 , 1] 
(base_matrix[ 1,2] 
if (det <> 0.0) then 
begin 

inverse_matrix[ 1, 1] 
inverse_matrix[ 1,2] 
inverse_matrix[ 2 , 1] 
inverse_matrix[ 2 , 2] 
end; 

end; 



* base_matrix[ 2 ,2] ) - 

* base_matrix[ 2 , 1] ); 



= base_matrix[ 2 , 2] /det; 

= base_matrix[ 1,2] * (-1) 
= base_matrix[ 2 , 1] * (*1) 
= base_matrix[ 1 , 1] /det; 



/det 

/det 
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procedure test_calculate_coord(basex,basey : ary2); 
var 

: integer; 

begin 

for i : = 1 to 2 do 
begin 

base_matrix[ 1 , i] := basex[ i] - basex[ i+1] ; 
base_matrix[ 2 , i] := basey[ i] - basey[ i+1] ; 
end; 

test_inverse(base_matrix, inverse_matrix); 
i2 := 1; 

for i : = 1 to interest ingno do 
begin 

if ((basex[lj <> x[ i] ) or (basey[ 1] <> y[i])) and 
((basex[2) <> x[ i] ) or (basey[2j <> y[i])) and 
((basex[ 3] <> x[ i] ) or (basey[3j <> y[i])) then 
begin 

rest_basex[ i2] : = x[ i] ; 

rest_basey[ i2] : = y[ i] ; 
i2 := i2 +1; 
end; 

end; 

for i : = 1 to interest ingno[ 3 do 
begin 

diff[l,l] := rest_basex[ i] - basex[ 3] ; 
diff[2,l] := rest_basey[ i] - basey[ 3] ; 
tes t_raat rix_mult ( inverse_raat rix , dif f , coord) ; 
count := count +1; 

write(coordinate,modelno, count ,coord[ 1, 1] ,coord[ 2,1] ); 
for il := 1 to 3 do 

write(output ,basex[ il] ,basey[ il] ); 
write ln( output); 
end; 

end; 

procedure test_perm(basex,basey : ary2; 

k : integer); 

var 

i,tx,ty : integer; 
begin 

if k = 3 then 

test_calculate_coord(basex ,basey) 
else 

for i : = k to 3 do 
begin 

tx : = basex[ i] ; 
ty : = baseyi i] ; 
basex[ i] := basex[k]; 
baseyi i] basey[k]; 
basex[ k] : = tx; 
baseyi k] := ty; 
test_perm(basex jbasey ,k+l); 
end; 

end; 
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procedure area_test( corax, corny : ary2); 

var 

s,a,b,c,sarea,area : real; 

begin 

a : = sqr(comx[ 2] [ comx[ 1] )+sqr(comy[ 2] ] coray [ 1] ); 

b := sqr(comx[ 3] [ comx[ 2] )+sqr(comy[ 3] ] comy[ 2] ); 

c : = sqr(corax[ 1] [ comx[ 3] )+sqr(comy[ 1] ] comy[ 3] ); 

a : = sqrt(a); 
b : = sqrt(b); 
c : = sqrt(c); 
s : = (a + b + c)/2. 0; 
sarea := s*(s[ a)*(s] b)*(s[ c); 
sarea := sqrt(sarea); 
area := tarea/10.0; 
if (sarea > area) then 
test_perm( comx, corny , 1); 

end; 

procedure comb(k, index : integer); 
var 

i : integer; 

begin 

if index > 3 then area_test(comx, corny) 
else 

for i : = k to interestingno do 
begin 

comx[ index] : = x[ i] ; 
comy[ index] : = y[ i] ; 
comb( i+1 , index+1 ) ; 
end; 

end; 

begin(* main *) 

open( input , * test_interesting_point. dat * , history : = old); 
reset( input); 

open(output , ' test_af f ine_coef f icient . dat* , history : = new); 
rewrite( output); 
table_size := 0; 
while not eof( input) do 
begin 

readln( input , mode Ino, interestingno); 
writelnC output , interestingno) ; 
for i ; = 1 to interestingno do 
readln( input ,x[ i] ,y[ i] ); 
count : =0; 
comb( 1,1); 

table_size := table_size + count; 
end; 

close( input); 
close(output); 

end. 






program test_inkey( input , output ) ; 

(* This module converts every bin index (i, j) to an inkey and generates 
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the tally data file *) 

(* i/p : test_af f ine_coef f icient data file 
o/p : tally data file *) 
type 

inrec = record 

modelno, tripletno : integer; 
keyl,key2 : real; 

basexl jbaseyl ,basex2 ,basey2 ,basex3 ,basey3 : integer 
end; 

var 

b : inrec; 

infile,outf ile : text; 
dk,kl jk2 , inkeyl : real; 
i 5 il , j , interest ingno , inkey : integer; 
begin 

open ( input , ^ test_af f ine_coef f icient. dat * , history: =old); 
reset( input); 

open (output , * tally. dat * , history: =new); 
rewrite( output ); 
il := 0; 

readln( input , interestingno); 
writeln(output , interestingno); 
dk := 2. 0*arctan(20. 0)/90. 0; 
while not eof( infile) do 
with b do 
begin 

readln( inf ile ,modelno , triple tno ,keyl ,key 2 , 

basexl ,baseyl ,basex2 ,basey2 ,basex3 ,basey3); 
kl := arctan(keyl)/dk; 
k2 := arctan(key2)/dk; 
if (kl >= 0. 0) then 
begin 

i : = trunc(kl) + 46; 
if (i > 90) then i := 90; 
end; 

if (kl < 0.0) then 
begin 

i := trunc(kl) + 45; 
if ( i < 1) then i : = 1; 
end; 

if (k2 >= 0.0) then 
begin 

j := trunc(k2) + 46; 
if (j > 90) then j := 90; 
end; 

if (k2 < 0. 0) then 
begin 

j := trunc(k2) 4- 45; 
if ( j < 1) then j : = 1; 
end; 

inkeyl ;= (0.839*i + 0. 364*j )*100; 

inkey := trunc( inkeyl); 

writeln( output , inkey, i, j , key 1, key 2 , 

basexl jbaseyl ,basex2 ,basey2 ,basex3 ,basey3); 
il := il+1; 
end; 
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close( infile); 
close(outfile); 
end. 



program af f ine_matching( input ,candfile, output); 

(* This module applies partial voting technique to select all the 
entries which satisfy the top[six]max criteria *) 

(* i/p : hash_table and tally data files 
o/p : vote data file *) 
const 

database_modelno = 2; 
type 

candrec = record 

inkey, i,j : integer; 
keyl,key2 : real; 

basexl jbaseyl ,basex2 ,basey2 ,basex3 ,basey3 : integer; 
end; 

modelrec = record 

hashkey, inkey , i,j ,modelno,tripletno, link : integer; 

keyl,key2 : real; 

basexl jbaseyl ,basex2 ,basey2 ,basex3,basey3, a : integer; 
end; 

collected_modelrec = record 

hashkey , inkey , i,j ,modelno, tripletno, link : integer; 

keyl,key2 : real; 

basexl ,baseyl ,basex2 ,basey2,basex3 ,basey3 , a : integer; 

votel : real; 

end; 

var 

temporary_model , temp : array[ 0. . 9999] of modelrec; 
model : array [ 0. . 23000] of modelrec; 

collected_model : array[ 1. . 9999] of collected_modelrec; 

tmodel jSmodel jgmodel ,praodel : array[ 1. . 1000] of collected_modelrec; 

cand : array[ 0. . 19999] of candrec; 

candl,cand2 : array [ 1. . 9999] of candrec; 

t cand, s cand, gcand,pcand : array[ 1. . 1000] of candrec; 

il,jl,k,kl,m, index, count ,n,prim, f ,h,g,hkey , ix, iy , jx, jy ,cl , c2 : integer; 
maxi 1 , maxi 2, maxi 3, maxl4, maxis , max 16 
max21 ,max22 ,max23,max24,max25 ,max26 
thl,th2 : real; 

table_size , interestingno, test_ inter estingno_3 , 
bl,b2,sl ,s2,w, tl, t2 : integer; 
candfile : text; 

vote : array[ 0. . database_modelno,0. . 27999] of real; 

outmodelno,outinterestingno : array [ 1. . database_modelno] of integer; 

procedure initialize!; 
var 

i,j : integer; 
begin 

for i : = 0 to database_modelno do 
for j : = 0 to table_size do 
vote[ i, j] : = 0. 0; 

end; 
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procedure print(i6,k : integer); 
begin 

with gmodel[ i6] do 
begin 

writeln( output ,hashkey, inkey ,raodelno: 2,tripletno: 4, 

keyl,key2,basexl: 4,baseyl: 4,basex2: 4,basey2: 4, 
basexS: 4,basey3: 4, vote 1 ,k); 
gcand[ i6] . keyl := keyl; 
gcand[ i6] . key2 : = key2; 
end; 

with gcand[ i6] do 

writeln( output , * * : 10 , inkey , ' * : 6 , keyl ,key2 ,basexl: 4 , 
baseyl: 4,basex2: 4,basey2: 4,basex3: 4,basey3: 4); 

end; 

procedure delet(h : integer); 
var 

j>jl,q>hl,l,w : integer; 

begin 

k := l;hl := 0;w := 0; 
while (k <= h) do 
begin 

if (smodel[k].a = 0) then 
begin 
j : = 0; 

q := smodel[ k] . inkey; 
for i : = 1 to h do 
begin 

if (smodel[ i] . inkey = q) and (j = 0) then 
begin 

j := j + 1; 
hi := hi + 1; 
gmodel[hl] := smodel[ i] ; 
gcand[hl] := scand[ i] ; 
end 
else 

if (smodel[ i] . inkey = q) and (j <> 0) then 
smodel[ i] . a : = 1; 

end; 

end; 

k : = k +1; 

end; 

if ( gmodel[ 1] . modelno = 1) and (hi >= tl) then 
begin 

for 1 := 1 to hi do 
print( 1 ,hl); 

end; 

if ( gmodel[ 1] . modelno = 2) and (hi >= t2) then 
begin 

for 1 := 1 to hi do 
print( 1 ,hl); 

end; 

end; 
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procedure selectl(pl : integer); 

var 

k,q,h,i : integer; 
begin 
k := 1; 

while(k <= pi) and (si = 0) do 
begin 

if (tmodel[k].a = 0) then 
begin 
h : = 0; 

q := tmodel[ k] . tripletno; 
for i : = 1 to pi do 
begin 

if (tmodel[ i] . tripletno = q) then 
begin 

h : = h + 1; 

smodel[h] := tmodel[ i] ; 
scand[h] := tcand[ i] ; 
tmodel[ i] . a : = 1; 
end; 

end; 

if (h >= tl) then 
delet(h); 

end; 

k : = k + 1; 
end; 

end; 

procedure select2(pl : integer); 

var 

k,q,h,i : integer; 
begin 
k := 1; 

while(k <= pi) and (s2 = 0) do 
begin 

if (tmodel[k].a = 0) then 
begin 
h : = 0; 

q := tmodel[ k] . tripletno; 
for i : = 1 to pi do 
begin 

if (tmodel[ i] . tripletno = q) then 
begin 

h : = h + 1; 

smodel[h] := tmodel[ i] ; 
scand[h] := tcand[ i] ; 
tmodel[ i] . a : = 1; 
end; 

end; 

if (h >= t2) then 
delet(h); 
end; 

k : = k + 1; 
end; 

end; 
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procedure all_maximun_selected(n : integer); 

var 

i5,pl : integer; 
begin 

if (si =0) then 
begin 

pi := 0; 

for i5 : = 1 to n do 

with collected_model[ i5] do 
if (modelno =1) and 

(( cand2[ i5] . inkey <> 0) and (votel = maxll)) then 
begin 

pi := pi + 1; 

tmodel[pl] := collected_model[ i5] ; 
tcand[pl] := cand2[ i5] ; 
end; 

selectl(pl); 

end; 

if (si =0) then 
begin 

pi : = 0; 

for i5 : = 1 to n do 

with collected_model[ i5] do 
if (modelno = 1) and 

(( cand2[ i5] . inkey <> 0) and (votel = maxl2)) then 
begin 

pi := pi + 1; 

tmodel[pl] := col lected_model[ i5] ; 
tcand[pl] := cand2[ i5] ; 
end; 

select l(pl); 
end; 

if (si =0) then 
begin 
pi := 0; 

for i5 : = 1 to n do 

with collected_model[ i5] do 
if (modelno = 1) and 

(( cand2[ i5] . inkey <> 0) and (votel = maxl3)) then 
begin 

pi := pi + 1; 

tmodel[pl] := collected_model[ i5] ; 
tcand[pl] := cand2[ i5] ; 
end; 

select l(pl); 
end; 

if (si =0) then 
begin 

pi := 0; 

for i5 : = 1 to n do 

with collected_model[ i5] do 
if (modelno =1) and 

(( cand2[ i5] . inkey <> 0) and (votel = raaxl4)) then 
begin 

pi : = pi + 1; 

tmodel[pl] := collected_model[ i5] ; 



76 



tcand[pl] := cand2[ i5] ; 
end; 

selectl(pl); 

end; 

if (si =0) then 
begin 

pi := 0; 

for i5 : = 1 to n do 

with collected_model[ i5] do 
if (modelno = 1) and 

( (cand2[ i5] . inkey <> 0) and (votel = maxlS)) then 
begin 

pi : = pi + 1; 

tmodel[pl] ;= collected_model[ i5] ; 
tcand[pl] := cand2[ i5] ; 
end; 

selectl(pl); 

end; 

if (si =0) then 
begin 
pi := 0; 

for i5 : = 1 to n do 

with collected_model[ i5] do 
if (modelno = 1) and 

( (cand2[ i5] . inkey <> 0) and (votel = maxl6)) then 
begin 

pi := pi + 1; 

tmodel[pl] := collected_model[ i5] ; 
tcand[pl] := cand2[ i5] ; 
end; 

selectl(pl); 

end; 

if (s2 =0) then 
begin 

pi := 0; 

for i5 : = 1 to n do 

with collected_model[ i5] do 
if (modelno =2) and 

((cand2[ i5] . inkey <> 0) and (votel = max21)) then 
begin 

pi := pi + 1; 

tmodel[pl] := collected_model[ i5] ; 
tcand[pl] := cand2[ i5] ; 
end; 

selectl(pl); 

end; 

if (s2 =0) then 
begin 

pi := 0; 

for i5 : = 1 to n do 

with collected_model[ i5] do 
if (modelno =2) and 

( (cand2[ i5] . inkey <> 0) and (votel = max22)) then 
begin 

pi := pi + 1; 

tmodel[pl] := collected_model[ i5] ; 
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tcand[pl] := cand2[ i5] ; 
end; 

selectl(pl); 

end; 

if (s2 =0) then 
begin 

pi := 0; 

for i5 : = 1 to n do 

with collected_model[ i5] do 
if (modelno = 2) and 

(( cand2[ i5] . inkey <> 0) and (votel = max23)) then 
begin 

pi := pi + 1; 

tmodel[pl] := collected_model[ i5] ; 
tcand[pl] := cand2[ i5] ; 
end; 

selectl(pl); 

end; 

if (s2 =0) then 
begin 

pi := 0; 

for i5 : = 1 to n do 

with collected_model[ i5] do 
if (modelno =2) and 

(( cand2[ i5] . inkey <> 0) and (votel = max24)) then 
begin 

pi := pi + 1; 

tmodel[pl] := collected_model[ i5] ; 
tcand[pl] := cand2[ i5] ; 
end; 

selectl(pl); 

end; 

if (s2 =0) then 
begin 

pi := 0; 

for i5 : = 1 to n do 

with collected_model[ i5] do 
if (modelno =2) and 

(( cand2[ i5] . inkey <> 0) and (votel = max25)) then 
begin 

pi := pi + 1; 

tmodel[pl] := collected_model[ i5] ; 
tcand[pl] := cand2[ i5] ; 
end; 

selectl(pl); 

end; 

if (s2 =0) then 
begin 
pi := 0; 

for i5 : = 1 to n do 

with collected_model[ i5] do 
if (modelno =2) and 

(( cand2[ i5] . inkey <> 0) and (votel = max26)) then 
begin 

pi := pi + 1; 

tmodel[pl] := collected_model[ i5] ; 
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tcand[pl] := cand2[ i5] ; 
end; 

selectl(pl); 

end; 

end; 

procedure verifyC j 1 ,k,m : integer; var n : integer); 
var 

iA,q : integer; 
begin 

for i4 : = 1 to m do 

with temporary_model[ i4] do 

if (modelno = temporary_model[ k] . modelno) and 

(tripletno = temporary_model[ k] . tripletno) then 
begin 

n : = n + 1; 

collected_model[ n] . hashkey := hashkey; 
collected_model[ n] . inkey := inkey; 
collected_model[ n] . modelno ;= modelno; 
collected_model[ n] , tripletno := tripletno; 
collected_model[ n] , keyl := keyl; 
collected_model[ n] . key2 := key2; 
collected_model[ n] . basexl := basexl; 
collected_model[ n] . baseyl := baseyl; 
collected_model[ n] . basex2 := basex2; 
collected_model[ n] . basey2 := basey2; 
collected_model[ n] . basex3 := basex3; 
collected_model[ n] . basey3 := basey3; 
collected_model[ n] . votel : = vote[ modelno, tripletno] ; 
for q := (jl - test_interest ingno_3) to j 1 - 1 do 
if ( abs( cand[ q] . key 1 - keyl) < 0.04) and 
(abs(cand[ q] . key2 - key2) < 0.04) then 
cand2[n] := cand[ q] ; 

end; 

end; 

procedure top_six_maximun(m : integer; var k : integer); 
var 

i3 : integer; 
max : real; 
begin 

max : =0. 0; 

for i3 : = 1 to m do 

with temporary_model[ i3] do 

if (vote[ modelno, tripletno] > max) then 
begin 
k :=i3; 

max := vote[ modelno , tripletno] ; 

if (modelno = 1) then 

begin 

if (max > maxll) then 
maxll : = max 
else 

if (max <> maxll) and (max > maxl2) then 
maxl2 : = max 
else 
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if ((max <> maxll) and (max <> maxl2)) and (max > maxl3) then 
maxl3 := max 
else 

if ((max <> maxll) and (max <> maxl2)) and ((max <> maxl3) and 
(max > maxl4)) then 
maxl4 := max 
else 

if (((max <> maxll) and (max <> maxl2)) and ((max <> maxl3) and 
(max <> maxl4))) and (max > maxl5) then 
max 15 := max 
else 

if ((max <> maxll) and (max <> maxl2)) and ((max <> maxl3) and 
(max <> maxl4)) and ((max <> maxl5) and (max > maxl6)) then 
maxl6 := max; 
end; 

if (modelno =2) then 
begin 

if (max > max21) then 
max21 := max 
else 

if (max <> max21) and (max > max22) then 
max22 : = max 
else 

if ((max <> max21) and (max <> max22)) and (max > max23) then 
max23 : = max 

else 

if ((max <> max21) and (max <> max22)) and ((max <> max23) and 
(max > max24)) then 
max24 : = max 
else 

if (((max <> max21) and (max <> max22)) and ((max <> max23) and 
(max <> max24))) and (max > max25) then 
max25 : = max 
else 

if ((max <> max21) and (max <> max22)) and ((max <> max23) and 
(max <> max24)) and ((max <> max25) and (max > max26)) then 
max26 : = max; 
end; 
end; 

end; 

procedure search(hkey , i , j , f : integer; var m : integer); 

var 

i2 : integer; 

begin 

12 : = hkey; 
while (i2 <> [1) do 
begin 

if (i = model[ i2] . i) and 
(j = model[i2].j) then 
begin 

m : = m + 1; 

temporary_model[ m] := model[ i2] ; 
with temporary_model[ m] do 
begin 

if f = 1 then 
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vote[ modelno,tripletno] := vote[ modelno, tripletno] + 1.0; 
if f = 2 then 

vote[ modelno, tripletno] := vote[ modelno, tripletno] + 0.5; 
if f = 3 then 

vote[ modelno, tripletno] := vote[ modelno, tripletno] + 0.25; 
end; 

end; 

i2 : = model[ i2] . link; 
end; 

end; 

procedure partial(prim, i , j , f : integer; var m : integer); 

var 

inkey, hkey : integer; 
inkeyl : real; 
begin 

inkeyl := (0.839*i 4 - 0. 364*j )*100; 
inkey := trunc( inkeyl); 
hkey : = inkey rem prim; 
s ear ch( hkey , i, j , f ,m); 
end; 

begin(* main *) 

open ( input , ^hash_table. dat* , history := old); 
reset( input); 

open (candfile, * tally, dat^history := old); 
reset( candf ile); 

open (ref ,* ref. dat’ , history ;= old); 
reset(ref ); 

open (output ,* vote, dat^history ;= new); 

r ewr it e ( output ) ; 

readln( input , table_s ize , prim) ; 

readln( candf ile, interest ingno); 

reading ref , thl , th2); 

test_interestingno_3 := interestingno - 3; 

initialize!; 

tl : = trunc( thl); 

t2 : = trunc( th2); 

il :=0;jl := 0;kl := l;cl := 1; c2 := 1; 
while not eof( input) do 
begin 

with model[ il] do 

readln( input ,hashkey, inkey , i , j , modelno, tripletno, key 1 ,key2 , 
basexl ,baseyl ,basex2 ,basey2 ,basex3 ,basey3 , link); 
il := il + 1; 

end; 

m ;= 0;k :=l;n ; = 0; f : = 1; g : = 2; h : = 3; 

(* partial voting *) 

while not eof( candf ile) do 
begin 

with cand[jl] do 
begin 

readln( candf ile, inkey, i, j ,keyl , key 2, basexl ,baseyl , 
basex2,basey2,basex3 ,basey3) ; 
hkey : = inkey rem prim; 
s ear ch( hkey, i, j , f ,m); 
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ix ; = i - 1; 
iy := i + 1; 
jx := j - 1; 
jy := j + 1; 

if ((i > 0) and (i < 91)) and ((jx > 0) and (jx < 
partial(prim,i, jx,g,m); 



if ((i > 0) and (i < 91)) and ((jy > 0) and (jy < 
partial(prim,i, jy,g,m); 



if ((ix 


> 0) and 


(ix 


< 91)) 


and 


((j > 


0) 


and C 


J < 


partialCprim, ix 


> j >S 


;>m); 












if ((iy 


> 0) and 


(iy 


< 91)) 


and 


((j > 


0) 


and C 


j < 


partialCprim, iy 


> 3,8 


:,m); 












if ((iy 


> 0) and 


(iy 


< 91)) 


and 


((jx 


> 0) 


and 


( jx 


partialCprim, iy 


, jx, 


h,m); 












if ((iy 


> 0 ) and 


(iy 


< 91)) 


and 


((jy 


> 0) 


and 


(jy 


partialCprim, iy 


,jy, 


h,m); 












if CCix 


> 0) and 


(ix 


< 91)) 


and 


(( jy 


> 0) 


and 


(jy 


partialCprim, ix 


,jy. 


h,m); 












if ((ix 


> 0 ) and 


(ix 


< 91)) 


and 


((jx 


> 0) 


and 


(jx 



partial(prim, ix, jx,h,m); 
end; 

jl := jl + 1; 

count := jl mod test_interestingno_3; 
if count = 0 then 
begin 

top_six_maximun(m,k); 
verifyC jl,k,m,n); 
m : = 0; 
initialize!; 
end; 
end; 

al l_maximun_selected( n) ; 
close( input); 
close( candf ile) ; 
close( ref ) ; 
close(output); 
end. 



91)) then 
91)) then 
91)) then 
91)) then 

< 91)) then 

< 91)) then 

< 91)) then 

< 91)) then 



tV Vc Vc Vr Vv V'T Vc Vc Vr tV Vv Vc Vc Vr Vc Vc Vc Vr Vv '#V Vc Vc Vc Vr Vc Vc Vc Vc 



program reconstruct( input , vote, ploting); 

(* This module does the inverse affine transformation to 
the interesting point sets of the qualified candidate 
(* i/p : model_interesting_point and vote data files 
o/p : ploting data file *) 



const 

totalmodelno 

type 

aryl = array 
ary2 = array 
ary3 = array 
ary4 = array 
ary5 = array 
ary6 = array 
ary7 = array 



= 2 ; 

[ 1. . 10] of integer; 

[ 1. . 999] of integer; 

[ 1. . 99] of real; 

[ 1. . 10 , 1. . 99] of integer; 
[ 1. . 3] of integer; 

[ 1. . 2 , 1. . 2] of integer; 

[ 1. . 2,1. . 2] of real; 



calculate 
triplets *) 
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ary8 = array of real; 

var 

orimodelno : aryl; 

select_basex,select_basey , test_basex, test_basey , rest_basex, 
rest_basey : ary2; 

hashkey 5 inkey ,modelno, tripletno : integer; 

recogmodelno , recoginteres t ing , vot , a : integer; 
collected_keyl , collected_key2 , votl ; real; 
test_recogx, tester ecogy, order ed_test_inter_coordXj 
ordered_test_inter_coordy , 

ordered_test_basex,ordered_test_basey : ary3; 

x,y joriinterestno ; ary4; 

oritXjOrity : ary5; 

base_matrix : ary6; 

inverse_matrix : ary 7; 

diff, coord : ary8; 

deletemodelno : array [ 0. . totalmodelno] of integer; 

vote,ploting : text; 
korder,jr : integer; 
i : integer; 



procedure matrix_irmlt( inverse_matrix : 

var diff, coord : 



const 




2 ; 

2 ; 



in = 1; 



var 

i,il,n : integer; 
begin 

for i : = 1 to 1 do 
for il := 1 to m do 
coord[ i, il] : = 0; 
for i : = 1 to 1 do 
for il := 1 to m do 
for n : = 1 to 1 do 

coord[i,il] := coord[i,il] + 
diff[ n, il] ; 

end; 



ary7; 

ary8); 



inverse_matrix[ i,n] 



* 



procedure inverse(base_matr ix : ary6; 
var 

inverse_matrix : ary7); 
var 

det : real; 
begin 

det := (base_matrix[ 1 , 1] * base_matrix[ 2,2] ) 
(base_matrix[ 1 , 2] * base_matrix[ 2 , 1] ); 
if (det <> 0. 0) then 
begin 

inverse_matrix[ 1 , 1] 
inverse_matrix[ 1,2] 
inverse_matrix[ 2, 1] 
inverse_matr ix[ 2 , 2] 
end; 

end; 



base_matrix[ 2 , 2] /det; 
base_matr ix[ 1,2] * ( “ 1 ) 
base_matrix[ 2, 1] * (-1) 
base_matrix[ 1 , 1] /det; 



/det; 

/det; 
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procedure calculate_coord( recogmodelno : integer; 

cbasex, cbasey : aryS); 



var 

i,m, il, i2, i3 : integer; 
begin 

for i : = 1 to 2 do 
begin 

base_matrix[ 1 , i] := cbasex[ i] - cbasex[ i+1] ; 
base_matrix[ 2 , i] := cbasey[ i] - cbasey[ i+1] ; 
end; 

inverse( base_matr ix , inverse_matr ix) ; 



i2 := 1; 

for i : = 1 to oriinterestno[ orimodelno[ recogmodelno] , 

recogmodelno] do 



begin 

if ((cbasex[lj <> x[ recogmodelno, i] ) 

or (cbasey[lj <> y[ recogmodelno, i] ) ) and 
((cbasex[2j <> x[ recogmodelno, i] ) 
or (cbasey[2j <> y[ recogmodelno,!] ) ) and 
((cbasex[3j <> x[ recogmodelno, i] ) 
or (cbasey[3] <> y[ recogmodelno,!] )) then 
begin 

rest_basex[ i] := x[ recogmodelno, i] ; 
rest_basey[ i] := y[ recogmodelno , i] ; 
diff[l,l] := rest_basex[ i] - cbasex[3]; 
diff[2,l] := rest_basey[ i] - cbasey[ 3] ; 
matrix_mult( inverse_matrix ,diff, coord); 
ordered_test_inter_coordx[ i] : =coord[ 1,1]* 

( ordered_test_basex[ 1] [ ordered_test_basex] 2[ ) + 
coord[ 2 , 1] *(ordered_test_basex[ 2] - 

ordered_test_basex[ 3] )+ 
ordered_test_basex[ 3] ; 
ordered_test_inter_coordy[ i] : =coord[ 1 , 1] * 
(ordered_test_basey[ 1] [ ordered_test_basey] 2[ )+ 
coord[ 2, 1] *(ordered_test_basey[ 2] - 

ordered_test_basey[ 3] ) + 
ordered_test_basey[ 3] ; 
end; 



end; 

for i : = 1 to oriinterestno[ orimodelno] recogmodelno[ , 

recogmodelno] do 
writeln(ploting,ordered_test_inter_coordx[ i] , 
ordered_test_inter_coordy[ i] ); 



end; 



rocedure colinear(var comx, corny : aryS; 

var tl,t2 : real); 

var 

col inearxl , colinearx2 , colineary 1 , colineary2 : integer; 
begin 

col inearxl : = comx[ 2] - comx[ 1] ; 

colinearx2 := comx[ 3] - comx[ 2] ; 

colinearyl : = comy[ 2] - comy[ 1] ; 

colineary2 := corny [ 3] - comy[ 2] ; 

if (colinearxl <> 0) then 
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tl := arctan(colinearyl / colinearxl) 
else 1 1 : = 1.5707; 
if (colinearx2 <> 0) then 

t2 := arctan(colineary2 / colinearx2) 
else t2 : = 1. 5707; 
end; 



procedure pretest (i,j : integer; 

var tl,t2 : real); 



var 

count : integer; 

begin 

count : = 1; 

while ((test_recogx[ j] <>0) or ( test_recogy[ j] <>0) ) 
(count < 4) do 



begin 

oritx[ count] : =x[ i, j] ; 
ority[ count] :=y[ i, j] ; 
ordered_test_inter_coordx[ 
ordered_test_inter_coordy[ 
ordered_test_basex[ count] 
ordered_test_basey[ count] 
j := j+1; 



count := count+1; 
end; 

CO 1 inear ( oritx , or ity , t 1 , t2) ; 
end; 



j] 

j] 



:= test_recogx[ j] ; 
: = test_recogy[ j] ; 
test_recogx[ j] ; 
test_recogy[ j] ; 



and 



procedure mapping(bx,by : real; 

var ordering : integer; 
i : integer); 

var 

j : integer; 

begin 

for j : = 1 to oriinterestno[ orimodelno[ i] , i] do 
begin 

if (abs(bx - x[i,j]) < 0.00001) and 
(abs(by - y[i,j]) < 0.00001) then 
ordering := j; 

end; 

end; 



procedure interest; 
var 

i,j : integer; 

begin 

open( input / model_interesting_point. dat history := old); 
reset( input); 

openCploting, * ploting. dat history := new); 

rewrite(ploting); 

i: =1; 

while not eof( interesting) do 
begin 

read( interesting, orimodelno[ i] ); 

readln( interesting, oriinterestno[ orimodelno[ i] , i] ); 
for j : = 1 to oriinterestno[ orimodelno[ i] , i] do 
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readlnC interesting, x[ orimodelno[ i] ,j] , 
y[ orimodelno[ i] , j] ); 
i := i+1; 
end; 

end; 

procedure recognized; 
var 

i,il,i2,j,jl : integer; 

s e 1 e c t_mode l_t empx , s e 1 e c t_mode l_t enipy ,tl,t2 :real; 
begin 

open ( vote vote, dat *, history := old); 
reset( vote); 
i :=1; 

while (not eof(vote)) do 
begin 

readln( vote,hashkey , inkey , mode Ino, trip letno, collect ed_keyl , 
col lected_key2 , 

select_basex[ 1] , select_basey[ 1] , select_basex[ 2] , 
select_basey[ 2] , select_basex[ 3] , select_basey[ 3] ,votl,a); 
readln( vote , inkey , col lected_keyl , collected_key2 , 
test_basex[ 1] ,test_basey[ 1] , test_basex[ 2] , 
test_basey[ 2] , test_basex[ 3] , test_basey[ 3] ); 
recogmodelno := modelno; 

if (votl/(oriinterestno[ orimodelno[ recogmodelno] , recogmodelno] -3) >= 0,5) th 
begin 

for J: =1 to 3 do 
begin 

mappingC select_basex[ j] , select_basey[ j] ,jr, 
recogmodelno); 

test_recogx[ jr] ;= test__basex[ j] ; 
test_recogy[ jr] := test_basey[ j] ; 
end; 

select_model_tempx := collected_keyl*(select_basex[ 1] - 
select_basex[ 2] )+ collected_key2*( select_basex[ 2] - 
select_basex[ 3] )+select_basex[ 3] ; 

select_model_tempy := col lected_keyl*( select_basey[ 1] - 
select_basey[ 2] )+ collected_key2*( select_basey[ 2] - 
select_basey[ 3] )+select_basey[ 3] ; 

mappingC select_model_tempx, select_model_tempy , jr , 
recogmodelno); 

test_recogx[ jr] := collected_keyl*( test_basex[ 1] - 
test_basex[ 2] )+ 

collected_key2*( test_basex[ 2] -test_basex[ 3] ) 

+test_basex[ 3] ; 

test_recogy[ jr] := collected_keyl*( test_basey[ 1] - 
test_basey[ 2] )+ 

collected_key2*( test_basey[ 2] -test_basey[ 3] ) 

+test_basey[ 3] ; 

for j 1 : = 1 to a[ 1 do 

begin 

readlnC vote , hashkey , inkey , modelno , tr ipletno , 
collected_keyl , collected_key2 , 

select_basex[ 1] , select_basey[ 1] , select_basex[ 2] , 
select_basey[ 2] , select_basex[ 3] , select_basey[ 3] ); 
readlnC vote , inkey , collect ed_keyl , collected_key2 , 
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test_basex[ 1] ,test_basey[ 1] , test_basex[ 2] , 
test_basey[ 2] ,test_basex[ 3] ,test_basey[ 3] ); 
select_model_tempx := collected_keyl*(select_basex[ 1] 
select_basex[ 2] )+ collected_key2*( select_basex[ 2] - 
select_basex[ 3] )+select_basex[ 3] ; 

select_model_tempy := collected_keyl*( select_basey[ 1] 
select_basey[ 2] )+ collected_key2*(select_basey[ 2] - 
select_basey[ 3] )+select_basey[ 3] ; 
mapp ing( s e 1 ect_mode l_t empx , s e 1 ect_mode l_t empy , j r , 
recogmodelno); 

test_recogx[ jr] : = collected_keyl*( test_basex[ 1] - 
test_basex[ 2] )+collected_key2* 

(test_basex[ 2] -test_basex[ 3] )+test_basex] 3[ ; 
test_recogy[ jr] := collected_keyl*( test_basey[ 1] - 
test_basey[ 2] )+collected_key2* 

(test_basey[ 2] -test_basey[ 3] )+test_basey] 3[ ; 
end; 

wr iteln( plot ing, recogmode Ino, or iinterestno[ 

orimodelno[ recogmodelno] , recogmodelno] ); 
il:=l; tl:=l; t2:=l; 
pretest( recogmodelno, il , tl ,t2); 
if tl<>t2 then calculate_coord( recogmodelno, 

oritx,ority) 

else 

pretest( recogmodelno, i 1+1 ,tl , t2); 
end; 
end; 

end; 



’ egin(* main *) 
interest; 
recognized; 
end. 
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